A FAKE SCHOTTKY GROUP IN Mod(S) 
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Abstract. We use the classical construction of Schottky groups in hyperbolic 
geometry to produce non-Schottky subgroups of the mapping class group. 



1. Introduction 

In hyperbolic geometry, a Schottky group is a free convex cocompact Kleinian 
group, classically constructed as follows. Pick four pairwise disjoint closed balls 
£?j~, E>2 , B± , B^ in S^ 1 , the ideal boundary of hyperbolic n-space. Suppose 
there are isometries fa and fa so that 



/ i (Sr) = 5ST 1 -S+. 

Then (fa, fa) is a Schottky group isomorphic to the free group F% of rank two. 

Now let S be a closed surface of genus g > 2 and let Mod(5) = 7r (Homeo + (S')) 
be its mapping class group. By way of analogy with the theory of Kleinian groups, 
B. Farb and L. Mosher defined [FM| a notion of convex cocompactness for subgroups 
of Mod(S'). In this setting, a Schottky group is a free convex cocompact subgroup of 
Mod(5). In |KL1|[KL2] . we extended Farb and Mosher's analogy, providing several 
characterizations of convex cocompactness borrowed from the Kleinian setting (see 
also Hamcnstadt [H]). The analogy is an imperfect one, see |KL3j and the references 
there, and we point out some new imperfections here. 

Theorem 1.1. There exist pseudo-Anosov elements fa and fa in Mod(S') and 
pairwise disjoint closed balls B^ ,B^ , Bf ,B^ in WMC(S) for which 



fa(Br) = FM£(S)-Bf 
and yet (fa, fa) = Fi is not a Schottky group. 

The construction is based on work of N. Ivanov, and it is clear from his work 
in [I] that he was aware of this construction (see also McCarthy |Mcj ) . The group 
G = (fa, fa) contains reducible elements and so fails to be convex cocompact. It 
is worth noting that there are sufficiently high powers of the fi that generate a 
Schottky group, as proven by Farb and Mosher [FMj . see also |KL1[ [H]. 

Part of the analogy between Kleinian groups and mapping class groups was 
developed by J. McCarthy and A. Papadopoulos [MP], who constructed a limit 
set Aq and domain of discontinuity Aq C PMC(S) — Ac for any subgroup G < 
Mod(S), see Section g] Unlike in the Kleinian setting, A G ^ PMC(S) - A G 



Date: September 23, 2008. 

1991 Mathematics Subject Classification. Primary 20F65 ; Secondary 30F60, 57M07, 57M50. 

Key words and phrases. Schottky group, mapping class group. 

The first author was supported in part by an NSF postdoctoral fellowship. 

The second author was supported in part by NSF Grant DMS-0603881. 



1 



2 



RICHARD P. KENT IV AND CHRISTOPHER J. LEININGER 



in general. While examples illustrate the necessity of taking an open set strictly 
smaller than FAiC(S) — Ac as a domain of discontinuity it is not clear that Ac 
is an optimal choice. In [KL1| . we asked whether or not Aq is the largest open set 
on which G acts properly discontinuously — sec Question 3 there. Here, we answer 
this in the negative. 

There is an obvious open set on which our group G = (/i,/2) acts properly 
discontinuously and cocompactly, namely 

fi = (J g -e 

gee 

where O is the closure of the complement of our four balls. To see that fi is open, 
note that is contained in the interior U of 

/ 1 (e)u/r 1 (e)u/ 2 (e)u/ 2 - 1 (6) 

and that 

fi= (J 9-U 

If the fi are chosen carefully, the set fi will contain Aq properly, and we have the 
following theorem. 

Theorem 1.2. There are irreducible subgroups G < Mod(5') for which Aq is not 
the largest open set on which G acts properly discontinuously. 

Asymmetry of the construction provides another domain fi' on which G acts 
properly discontinuously, and we will also show that G does not act properly dis- 
continuously on the union fi U fi'. 

Though Ag is not a maximal domain of discontinuity, we show in Section[5]that, 
for the groups in Theorem 1 1.21 it is nonetheless the intersection of all such maximal 
domains. 

2. Surface dynamics 

If X is a subset of VMC(S), we let 

ZX = {[v] e VMC(S) | i{v,n) = for some \p] e X} 

be the zero locus of X. If X = {[x]} we sometimes write Zx for ZX. 

If / is pseudo-Anosov, then it acts with north-south dynamics on ¥MC(S), 
meaning that it has unique attracting and repelling fixed points \fit] and \pLj], 
respectively — all other points are attracted to [pL^] under iteration of /. In fact, for 
any neighborhood U of [p^] and any compact set K C PMC(S) — {[p.J]}, there is 
a natural number N so that 

(2.1) f n (K) C U 

for any n > N. 

Ivanov proves that there is a similar situation for most pure reducible elements 
(see the Appendix of [I]). In particular, suppose a is a nonscparating simple closed 
curve in S preserved by a mapping class <j) that is pseudo-Anosov when restricted 
to S — a. Let [fi^] and [/z7] be the stable and unstable laminations for (f> in S — a 
considered laminations on S, and note that 

= {[s^ + (1 - s)a] e PMC(S) | s e [0, 1]}. 
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If K C PMC(S) — Zfj,, is a compact set and U a neighborhood of [/xl], then there 
is an N > such that for all n > N we have 

(2.2) 4> n {K) C U. 

Given a mapping class g of either type above, let X(g) denote the expansion 
factor of g, the number such that 

9(l4) = X (d)f4 ■ 

3. The construction 

Let a be a nonscparating curve fixed by a mapping class <p that is pseudo-Anosov 
on S — a, and let [/uj] and [n^] be as in the previous section. 

Let §0 C PMC(S) be a bicollared (6c/-8)-dimensional sphere dividing ¥MC(S) 
into two closed balls and containing Z\i~^ and [/til'], respectively. 

According to (|2.2p . there is an > so that for all n > N we have 

cf> n (B (t> ) C int(B*). 

So we choose an n > A, let h = 0", Bjj" = A$, and = h(B<p). 
Recall H. Masur's theorem [Ma that the set 



KJ) I V> G Mod(S*) pseudo-Anosov} 

is dense in P.M/^S) xVA4C(S). So we choose a pseudo-Anosov ijj whose fixed points 
and 1/1,^] lie in ¥MC(S) - (B^ U We let §^ C PX£(S) - (5,; U B+) be 
a bicollared (6<? — 8)-sphere which bounds two balls: A$ C VMC(S) - (B^ U B£) 
containing [/x^] and containing [/x^]. As PA / (£(S') — (B^UB^) is a neighborhood 
of [/x^], (|2.ip provides an M > such that for all m > M, we have ij) m (B,,p) C 
FM£(S) — (B^ U-BjJ"). Arguing as in [I], we may choose m so that ^j m h is pseudo- 
Anosov, and we do so. We let / = ip m , BJ = A^, and B+ = f(B^). 
We now have elements f,h, and pair wise disjoint closed balls 



B h' B h' B f > B f 



ith 



h(B-) = VMC(S) - B+ and f(BJ) = VMC(S) - Bp 

See Figure [U 

Let G = (f,h), set 



9 = FMC(S) - (B,7 UB+UBj UB+ 
and let 

o = (J 5 ■ e. 

96G 

The group G acts on properly discontinuously and cocompactly with fundamental 
domain O, and the usual ping-pong argument implies that G = Fi. 
A slight modification now provides the desired example. 

We let fi = fh and fi = /, both pseudo-Anosov by construction. Of course, 
G = (fx, f2j, and we need only find balls Bf and B^ with 



(3.1) f t (Br)=VMC(S)-B: 
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Figure 1. 

Set B-f = B^ and = f(B^). The ball B^ is constructed as a regular neigh- 
borhood of Bj UB^US in FMC(S) - {B^ U Bf), where (5 is an arc in 9 from Bj 

to B+. The ball B+ is defined to be ¥MC(S) - f{B^). See Figured 
One can now check (|3.f p . 

4. Proper discontinuity 

Let G = (h, f) be the group constructed in the previous section, and let dG be 
the Gromov boundary of G. By the work in [MPJ, the limit set 

A G = {[f4] G PMC{S) | g i G is pseudo-Anosov} 

is the unique minimal closed G-invariant subset of PA^£(5). In |KL2j we showed 
that one may choose h and / as above so that G has the following property. 

Property 4.1. There exists a continuous G-equivariant homeomorphism 

3: dG — > A G . 

Moreover, for each x £ dG which is a fixed point of a conjugate 9 h of h, 3(x) is 
the stable or unstable lamination of that conjugate 9 h (respecting the dynamics). 
Otherwise 3(x) is a uniquely ergodic filling lamination. In particular, every element 
g £ G not conjugate to a power of h is pseudo-Anosov. 

We henceforth assume that G satisfies Propertv l4.il 
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Figure 2. 

The domain of discontinuity is defined to be 

A G = PM£{S) - ZA G . 

This is an open set on which G acts properly discontinuously [MP] , which justifies 
the name. 

We may describe the zero locus ZAq for G explicitly. For each conjugate 9 h of 
h, we have the attracting and repelling fixed points xf h in dG. By Property 14.11 
the map 3 sends these to the stable and unstable laminations 

For any such point g[fJ^] G Aq, the set Zgfi^ = gZfij^ is a 1-simplex in ZKq- 
Since 3{x) is uniquely crgodic and filling for every other point x G dG, it follows 
that ZKq is the union of Ac and all of these intervals. 

The intervals Zfi^ an d intersect each other at a, and so the union 

I h = Zfi~ U 

is an interval joining fj,7 to fit. All in all, we have 

(4.1) ZA G = A G u\Jgh 

sec 

We impose one further restriction on h and / — more precisely, on the balls . 
Since the fixed points of / do not meet the interval J^, we may replace / with a 
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power so that the balls are disjoint from this interval. This implies that 

int Z/j+ = Z^l+ n (J h n Q 

and so Z\x^ intersects the h n translates of 8, and no other G-translates. As Z/iJ^ 
does not intersect fi, these are the only G-translates of that intersects. Write 

S h = dB h and S / = dB f ■ 
We claim that 

£+ n zAq = 0. 

To see this, note that if T,~^ nontrivially intersected ZAq, it would do so in some 
g$h, by (|4. 1|) : and then g must be a power of h, since lies in 6. But hSh = hi, 
and so £j would intersect JT/j, contrary to our choice of /. The claim follows. 
Now, Theorem II .21 will follow from 

Theorem 4.2. The set Aq is properly contained in Q. In fact, 



n = FMC(S) - A G u(J gZn 
\ gee 




First note that A G ^ H as H h C C f2 nontrivially intersects C ZAq = 
VMC{S)-A G . 

To prove the containment, we must gather some information about the comple- 
ment of n. Let X = ¥MC(S) - Cl. 

Lemma 4.3. There is a continuous G-equivariant map 

A: X^dG. 

Proof. The spheres £± and T,f are bicollarcd with collars N(£^) and N(Ef). We 
assume as we may that 

h(N(^)) = iV(S+) and f(Npj)) = JV(E+) 

and that all of the G-translates of these collars arc pairwisc disjoint. 

Let Q be the Cayley graph of G and identify dG = dQ. We define a continuous 
G-equivariant map 

n^g 

by identifying Q with the tree dual to the hypersurface 

U 9&h) U (J -9( S 7) 
gea 9 eG 

in and projecting in the usual manner, see |Sh| . 

The map extends continuously to a G-equivariant map 

&: PM£{S) -► Q = G U dG 

whose restriction to X is the map we desire. The extension is described concretely 
as follows. 

First note that given any point [77] £ X, there is a unique sequence of elements 

ei £2 «3 
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where Xi £ {/, h} and e, 6 {±1} with the property that [77] is contained in the 
nested intersection 

00 

fl-'v >• 

where B^ 1 = B^ and B^ 1 = B^. Identifying dG with the set of infinite reduced 
words, our map is given there by 

R([ V })=xfxfxf---. 

To see that & is continuous, let U g C Q be the open set consisting of all infinite 
reduced words in dG with prefix g together with the union of the open tails of the 
corresponding paths in Q. Now if g ends in Xq° with xq € {h, /} and eo S {±1}, 
then 

8r 1 (U g )=gxo e °(mtBZ) 
which is open. □ 

Lemma 4.4. & is a one-sided inverse to J. That is, ^o3 = idga- 

Proof. Since X is a G invariant closed set, it contains A^, and so RoJ is well-defined. 
Next, suppose that x~j is the attracting fixed point of /. Then 3(x~f) = \p^] is the 
attracting fixed point in PMC(S) of /, and hence &(3(x~f)) = x~j~ . The same is 
true for any conjugate of /, and hence £.0 3 is the identity on the set of attracting 
fixed points of conjugates of /. Being G— invariant, this set is dense in dG, and so, 
by continuity, & o 3 is the identity on all of dG. □ 

Theorem 14.21 follows easily from the following lemma. 

Lemma 4.5. For all x € dG, we have R~ 1 (x) C Z3(x). In fact, if x is the repelling 
fixed point x~ h of a conjugate 9 h of h, then ^T 1 (x) — gZ[i~^. Otherwise, the set 
$$T (x) is a singleton contained in Kq. 

Proof of Theorem \4.S\ assuming Lemma \4-.5\ By the first statement, X C ZA G since 

ZA G = (J Z3(x). 

xedG 

So ft D Ag as required. Again, the containment is proper as Z/i^ nontrivially 
intersects fi. 

The description of fl follows from the second and third statements. □ 

We need the following general fact about sequences of laminations. 

Lemma 4.6. Suppose & C A4C(S) is a compact set, {fk} C Mod(iS) is an infinite 
sequence of distinct pseudo-Anosov mapping classes with 

in M.C{S), and that {vk}kLi C & and {tk}%%i C R+ are sequences with 

tkfkW) -> V 

mMC(S). 

If there is an r > such that 

1(1/,^) > r 

for all v £ &, then tk — > 0. 
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Proof. Note that continuity of i and compactness of S imply that there exist K > 
and R > 1 such that for all k > K and all v € & 

~<i(y tl j.f h )<R. 
By the continuity of i we have 

and so, for sufficiently large k, we have 

Kv, M~) - 1 < i(tkfk(vk), fJ-jJ < i(v, M~) + 1- 
The central term of this inequality is also given by 

i (tk fk (Vk) , M/J = i favk , /fe" 1 (nj k ) ) 

where A(/fe) is the expansion factor of and so, for all sufficiently large fc, we 
have 

* (?7 '^ ) ~ 1 < tfcA(/fe) < ^^^) + 
Since the are all distinct, and their fixed points converge in PA / J£(5), it follows 
that A(/fe) — > oo. So £fc — * as required. □ 

Proof of Lemma \4-.5\ First assume that x 6 SG is the fixed point of a conjugate of 
h. By the G-equivariance of it suffices to consider the case of h itself. Then, we 
have x = x\ or x = x^. In this case, the sequences of balls nesting to A~ 1 (x^) 
and & (xZ) are given by 

{h k (B+)}%« =1 and {h^Br)}^, 



respectively 

From the discussion in Section [21 we already know that 

oo 

fe=i 

and 

OO 

z-'k) = n ^" fc ( B h) = z h = z3 ( x h)- 

k=l 

If g € G is any other element not conjugate to a power of h, then, by Property 
14.11 g is pseudo-Anosov, and the dynamical properties of pseudo-Anosov mapping 
classes discussed in Section [5] implies 

&- 1 (x ± (g)) = {l^(g)}}=Z3(x ± (g)). 

Therefore, to complete the proof of the lemma, we assume that x G dG is not a 
fixed point of any element of G. 

We write x as an infinite reduced word 

ei £2 €3 
- — Ju -y lV 2 

Since x is not the fixed point of any element of G, we can assume that x n = f and, 
say, e n = +1 for infinitely many n (the case that x n = f and e„ = — 1 for infinitely 
many n is similar). The G-equivariancc of K implies that we may also assume that 
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x\ = f and ei = 1. Let {nk}^ = i be the increasing sequence of natural numbers for 
which Xn k = f and e„ fc = +1. Finally, set 

fk = %\ %2 X 3 ' ' ' G G. 

Then, we have A~ 1 (x) expressed as the nested intersection 



= n Mb}). 



k=l 

Any point [rj] in the frontier of M.^ 1 (x) is a limit of a sequence in the frontiers 

M = lim fk{[vk}) 

k~ >oo 

where 

[v k ] G Fr(B+) = £+ 

We fix any such [77] G Fr(^ _1 (a;)) and such a sequence {[1^]}. 

We pass to a further subsequence so that — > /i ± G A / f>C(S r ). Since [/i^J £ Ac 

for all k, we also have [/i^ € A(j. Iu fact, since fk = x^ 1 ■ ■ ■ Xn[ k is cyclically 
reduced, the axes for fk in Q all go through the origin and limit to a geodesic 7 C Q 
through 1 with positive ray ending at x. Therefore, x} k — > x as k — > 00, and by 
continuity of 3, it follows that 

3(x) = e A G . 

Moreover, the negative ray of 7 ends at some point y £ dG and is described by an 
infinite word 

5 1 So $3 

V = 2/i 2/ 2 % ' ■ ' 

where y\ x ^ / since = / and 7 is a geodesic. Therefore, again appealing to the 
continuity of 3 we see that 

3(2/) = [/*-] e a g dpmc(S)-b+. 

By similar reasoning, for any G Aq (~l B} , we have 

- [/!+] = 

In fact, it follows from |MP[ Lemma 2.7] that there is a [i (a fixed point of a 
pseudo-Anosov in G) and a sequence s& tending to zero such that 

lim s k f k (ji) = fi + £ MC(S). 

k — >oc 

We now let 6 C A4£(S) be the image of T,} under some continuous section of 
MC(S) -> FMC(S). Since £+ n ZA G = 0, there is an r > such that 

i(^,pi ± ) > r 

for every v £ &. 

We take the representatives Vk of [i>k] to lie in &. Then, according to Lemma 
14.61 the sequence tk for which 

lim t k fk(vk) = V 

k — >oo 

must tend to zero. So 

«(77,/x + ) = lim i(tkfk(vk),Skfk(fJ>)) = um tkSki(v k ,n) =0 

k — *oo k — ►oo 
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since Sk and tk tend to zero and is uniformly bounded by compactness of 

6. Since n + is uniquely ergodic, we conclude that [77] = [fi + ] = 3(x). 
This means that the frontier of ^ 1 (x) is precisely {3(x)}, and hence 

ST\x) = {3(x)} = Z3(x) 

as required. □ 



5. Final comments 

If we replace h with hr 1 in our construction we obtain another G-invariant open 
set fi' on which G acts properly discontinuously and cocompactly. By Lemma l4.5[ 
we have descriptions 

fl = PMC(S) - I A G U (J gZfi h 



and 



and it follows that 



Si' = ¥MC(S) - ( A G U |J gZ^+ ] , 

sec? 



nun' = FM£(S) - I a g u (J g 

seG 



a 



The group G does not act properly discontinuously on SI U SI' , and in fact, we have 
the following. 

Proposition 5.1. If IA C PA^£(S') is any open set on which G acts properly 
discontinuously, then IA C f2 or IA a SI' . 

Proof. Let W C PA / (£(S') be a G-invariant open set. We will show that if IA is not 
contained in either SI or SI', then G does not act properly discontinuously on IA. 

If IA flA G ^ 0, then since G acts minimally on A G and IA is G-invariant, we must 
have A G C U. As G clearly fails to act properly discontinuously on U in this case, 
we assume that IA n Ag = 0. 

So if IA fails to be contained in either SI or SI', there are points [r] + } eMfl Z/IT 
and [17 - ] G IA n Z/i^. Moreover, [n"* 1 ] is in the interior of . Let T ± be small 
compact balls contained in IA containing [rj^]. Since [n + ] £ SI, we may assume that 
T + C SI. Moreover, G-invariance of IA allows us to pick [n + ] and T + to lie in B7. 

After passing to a subsequence, we can assume that the sequence of sets 
{h~ kj : (T + )}°^ 1 converges in the Hausdorff topology. Moreover, we have 



lim h- k i(T+) C Pi h- k (B-) = Zfi: 

— vm 



3 " k=i 

Note that the Hausdorff limit must be connected since T + is. This limit contains 
a as the pointwise limit of h~ k {i] + ], and [fi^] as the pointwise limit of any other 
point of T + under h~ k . Therefore, 

lim h~ k HT + ) = Zfi-. 
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Now, consider the compact set T = T + U T . Since int(T ) is a neighborhood 
of [r/~], we have 

h~ kj (T) n T D fc- fc i(T + )nint(T-) ^ 
for all sufficiently large j. So G does not act properly discontinuously on U. □ 

From this we deduce that £1 and Q' are the only maximal open sets on which G 
acts properly discontinuously. By our descriptions of O and Q' we also have 

A G =Qnfl'. 

It follows that Aq can be described purely in terms of the action of G on FA4£(S), 
without referring to geometric structures on the surface. 

Though Ac may not be a maximal open set on which G acts nicely, it remains 
a canonically defined one, and we pose the following question. 

Question 5.2. If G is an irreducible subgroup of Mod(5), is Ac is the intersection 
of all maximal open sets on which G acts properly discontinuously? 

References 

[FM] B. Farb and L. Mosher, Convex cocompact subgroups of mapping class groups, 
Gcom. Topol. 6 (2002), 91-152 (electronic). 

[H] U. Hamenstadt, Word hyperbolic extensions of surface groups, Preprint, 
arXiv : math . GT/ 0505244. 

[I] N. Ivanov, Subgroups of Teichmuller modular groups, Translated from the Russian by E. 
J. F. Primrose and revised by the author. Translations of Mathematical Monographs, 115. 
American Mathematical Society, Providence, RI, 1992. xii+127 pp. 

[KL1] R. Kent. IV and C. Leininger Shadows of mapping class groups: capturing convex cocom- 

pactness, to appear in GAFA. 
[KL2] R. Kent. IV and C. Leininger Uniform convergence in the mapping class group, Ergodic 

Theory Dynamical Systems 28 (2008), 1177-1195. 
[KL3] R. Kent. IV and C. Leininger Subgroups of the mapping class group from the geometrical 

viewpoint, In the tradition of Ahlfors— Bers IV, Contemp. Math., 432, Amer. Math. Soc, 

Providence, RI, 2007. 

[Ma] H. Masur, Dense geodesies in moduli space, Riemann surfaces and related topics: Proceed- 
ings of the 1978 Stony Brook Conference (State Univ. New York, Stony Brook, N. Y., 1978), 
pp. 417-438, Ann. of Math. Stud., 97, Princeton Univ. Press, Princeton, N. J., 1981. 

[Mc] J. McCarthy, A "Tits-alternative" for subgroups of surface mapping class groups, 
Trans. Amer. Math. Soc. 291 (1985), no. 2, 583-612. 

[MP] J. McCarthy and A. Papadopoulos, Dynamics on Thurston's sphere of projective measured 
foliations, Comment. Math. Helv. 64 (1989), no. 1, 133-166. 

[Mo] L. Mosher A hyperbolic-by-hyperbolic hyperbolic group, Proc. Amer. Math. Soc. 125 (1997), 
no. 12, 3447-3455. 

[Sh] P. Shalen Representations of 3-manifold groups, Handbook of geometric topology, 955-1044, 
North-Holland, Amsterdam, 2002. 

Department of Mathematics, Brown University, Providence, RI 02912 
E-mail address: rkentOmath.brown.edu 

Department of Mathematics, University of Illinois, Urbana, IL 61801 
E-mail address: cleinOmath.uluc.edu 



